HD28 


DEWEY 


WORKING  PAPER 
ALFRED  P.  SLOAN  SCHOOL  OF  MANAGEMENT 


ON-LIlsE  GROUP  MANAGEMENT  PROCESS  SUPPORT 

Tony  E.  Gear,  Balliol  College,  Oxford 

Martin  J.  Read,  Decision  Dynamics,  England 

SSWP#3561-93 


MASSACHUSETTS 

INSTITUTE  OF  TECHNOLOGY 

50  MEMORIAL  DRIVE 

CAMBRIDGE,  MASSACHUSETTS  02139 


on-liinE  group  management  process  support 

Tony  E.  Gear,  Balliol  College,  Oxford 

Martin  J.  Read,  Decision  Dynamics,  England 


SSWP//3561-93 


MASSACKUSEHS  INSTITUTE 
OF  TECHNOLOGY 


NOV  1  4  2000 


LIBRARIES 


ON-LINE  GROUP  MANAGEMENT  PROCESS  SUPPORT 

Tony  E.  Gear,  Balliol  College,  Oxford 

Martin  J.  Read,  Decision  Dynamics,  England 

1 .   INTRODUCTION 


When  alternatives  have  been  debated  by  a  group,  and  all  the  members  accept 
that  in  the  circumstances  a  particular  solution  represents  the  best  choice, 
it  is  said  that  a  consensus  has  emerged  from  the  meeting.  In  situations  in 
which  participants  in  the  decision-process  do  not  agree  on  personal 
preferences,  they  may  still  be  able  to  agree  on  specific  actions  or 
policies.  Minkes  1351  proposes  "that  good  decision  here  means  precisely 
that  it  is  capable  of  securing  consensus".  But,  of  course,  not  all 
consensus  decisions  are  "good"  in  terms  of  other  criteria  such  as  survival, 
for  example. 

This  argument  is  based  on  pragmatism  in  decision-making.  In  management 
terms,  "the  most  important  test  is  that  everyone  is  prepared  to  act  as 
though  it  was  their  preferred  solution".  Adair  1 13  .  Accepting  this  view, 
true  consensus  may  only  emerge  if  sufficient  and  appropriate  communication 
has  taken  place  within  the  group.  However,  the  nub  of  the  problem  is  that 
thorough  debate  can  be  very  time-consuming  and  hard  to  achieve  in  complex 
situations. 

People  come  into  the  group  with  different  goals,  perspectives  and  value 
systems  which  emerge  in  the  context  of  communication.  Various  authors  have 
emphasised  the  importance  of  communication  in  groups  perceived  from  their 
own  viewpoint.  This  paper  supports  that  view  by  describing  a  series  of  case 
applications  of  on-line  technology  to  support  management  meetings  and  groups 
engaged  on  a  wide  variety  of  tasks. 

The  paper  is  centrally  concerned  with  aiding  social  processes  in  groups,  on 
the  way  to  reaching  decisions.  We  argue  that  careful  attention  needs  to  be 
given  to  the  group  process,  separated  from,  but  related  to,  individual 
functioning  15,30,33,553  The  contention  is  that  an  appropriately  organised 
group  communication  process  is  a  necessary  condition  for  achieving  a  'good' 
decision  as  defined  by  Minkes.  This  philosophy  has  been  discussed  by 
McCelland  C 313  in  terms  of  a  search  for  consensus. 

The  importance  of  communication  in  groups  is  not  a  new  theme.  The  use  of 
on-line  technology  to  aid  group  processes  is  quite  novel.   In  Section  3  we 


describe  a  particular  form  of  on-line  group  technology  which  we  have 
developed  to  support  group  processes,  and  in  Section  4  we  describe  a  series 
of  field  studies  of  applications  of  this  system  in  varied  managerial 
settings.  All  of  the  situations  relate  to  meetings  with  real  consequences, 
rather  than  to  transitory  laboratory  settings  with  ad  hoc  groups.  Several 
researchers  have  pointed  out  differences  in  conclusions  drawn  from  studies 
in  contrived  as  opposed  to  in  situ  situations  (e.g.  C 81 ) .  The  cases  which 
we  describe  all  had  important  implications  for  the  organisations  concerned. 
For  this  reason  a  varying  degree  of  anonymity  has  been  maintained.  We 
describe  situations  involving  full  face-to-face  communication  between  the 
participants;  varying  time  synchronizations  in  terms  of  when  participants 
submit  responses  during  the  meeting;  variously,  both  group  and/or  individual 
participant  goals;  and  situations  where  group  members  share  equal 
communication  rights,  with  one  member  having  the  additional  role  of 
chairperson  or  leader. 

In  Section  5  we  develop  a  generalised  process  framework  which  is  based  on 
our  fieldwork  and  the  existing  literature.  The  framework  provides 
guidelines  for  hardware,  software,  and  protocol  design  of  room-based 
meetings  support  systems.   Finally,  we  draw  some  conclusions  in  Section  6. 

Developments  in  the  area  of  group  decision-aiding  can  usefully  build  on  from 
research  and  developments  in  a  number  of  associated  fields,  particularly 
multiple  criteria  decision  analysis,  group  processes  in  social  psychology, 
management  oriented  group  techniques,  as  well  as  burgeoning  capabilities  in 
information  technology.  In  the  following  section,  we  briefly  review  related 
work  in  these  extensive  areas. 

2.   RELATED  WORK  AND  DISCIPLINES 

There  is  growing  interest  in  Group  Decision  Support  Systems  (GDSS)*.  Much 
of  this  literature  has  been  concerned  with  establishing  concepts  and 
principles,  and  reporting  trials  in  laboratory  settings.  As  Lewandowski 
( 29J  has  pointed  out:  "Much  less  discussion  is  devoted  to  the  practical 
implementations  and  applications  of  a  GDSS".  We  are  concerned  with  the 
design  and  implementation  of  a  GDSS  in  a  number  of  actual  and  varied 


See,  for  example,  the  many  papers  presented  at  the  International 
Conference  on  Decision  Support  Systems  (DSS)  run  annually  from  1981  by  the 
TIMS  College  on  Information  Systems,  Institute  of  Management  Sciences, 
Providence,  HI  02093. 


decision  environments,  as  a  step  in  the  direction  of  relating  designs  and 
methods  for  the  use  of  GDSS  to  different  decision  contexts.  In  this 
connection  see,  for  example,  1261  for  a  study  of  taxonomies. 

Decision-making  in  a  group  is  a  complex  process  involving  the  consideration 
of  alternatives  and  of  attributes  with  which  to  judge  them.  This  will 
commit  the  group  members  to  an  analysis  of  their  opinions  and  judgements  in 
relation  to  both  qualitative  and  quantitative  factors,  as  well  as  to  a 
consideration  of  imperfect  information  and  risks.  No  entirely  satisfactory 
decision  theoretic  framework  for  decision-making  in  groups  exists.  To 
achieve  this  it  would  be  necessary  to  construct  the  means  of  aggregating 
individual  judgements  into  a  collective  result  to  represent  group 
preferences  in  a  consistent  and  fair  way.  There  are  fundamental  problems 
associated  with  this  apparently  laudable  objective.  See  in  particular  Arrow 
133,  and  also  114,371.  Whilst  it  is  not  possible  to  meet  all  the 
requirements  of  rationality  and  fairness  in  one  group  preference  function, 
it  is  nonetheless  important  to  search  for  useful  and  explicit  methods  of 
aggregation  if  decision  analytic  methods  are  to  be  used  as  an  aid  to 
reaching  agreement  in  conjunction  with  GDSS.  Some  of  the  more  promising  of 
these  have  been  described  and  evaluated  in  (491. 

The  case  studies  described  in  Section  4  all  depend  on  feedback  of  individual 
judgements  so  that  their  differences  and  agreements  are  mirrored  back  to  the 
group.  This  raises  theoretical  issues  concerned  with  the  use  of 
interpersonal  comparisons  of  utilities  based  on  interval  scales  of 
measurement.  The  assumption  that  interpersonal  comparision  of  utilities  is 
impossible  is  crucial  to  Arrow's  proof  of  the  non-existence  of  an 
aggregation  procedure  which  completely  satisfies  a  set  of  defined  axioms. 
Rapoport  1 401  has  discussed  both  formal  and  psychological  aspects  of  this 
fundamental  issue.  It  should  be  noted  that  Dalkey  (141  has  shown  that 
consistent  group  preference  functions  can  be  formulated  by  the  use  of 
anchored  individual  preference  scales  with  fixed  reference  objects.  From  a 
practical  viewpoint.  Churchman  [121  argues:  "The  philosophy  of  subjective 
preferences  is  based  on  the  notion  that  one  is  fundamentally  constrained 
from  "peeking  into"  another's  mind  and  that  there  is  no  way  to  design  an 
inquiring  system  so  that  the  constraint  is  removed".  He  then  points  out 
that  once  this  position  is  rejected,  the  problem  can  be  defined  as:  "Are 
such  scalar  comparisons  desirable  and  what  kind  of  an  inquiring  system 
design  would  permit  such  comparisons?" 


In  practice,  group  or  committee  based  decisions  emerge  as  an  outcome  of  a 
social  process.  Usually,  the  group  meets  in  order  to  reach  decisions  as  a 
part  of,  or  on  behalf  of,  an  organisation  or  institution  of  some  kind.  The 
personal  skills,  personalities  and  backgrounds  of  the  individual 
participants,  the  cultural  setting  and  history  of  the  situation,  all  have  an 
influence.  "Social  Representations  are  important  because  they  constitute  a 
society's  symbolic  or  mediated  reality,  which,  once  common  currency,  affects 
not  only  communication  but  societal  and  personal  decision-making", 
Himmelweit  t 241 .  The  process  by  which  social  representations,  or  networks 
of  interacting  concepts  and  images,  evolve  to  become  common  currency 
"depends  on  the  complexity  and  speed  of  communication  as  well  as  on  the 
available  communication  media"  (Moscovice,  (361.  For  a  review  of  the 
relationship  between  social  representations  and  GDSS  see  1181. 

We  believe  that  it  is  the  design  and  support  of  the  social  process  that  is 
the  key  to  successful  implementation  of  GDSS  for  a  given  group  or  committee. 
The  decision-theoretic  framework  must  be  selected  in  conjunction  with 
definition  of  the  way  that  the  social  process  is  to  be  supported.  This 
selection  must  consider  the  group  decision  model  and  its  inevitable 
short-comings,  the  history  of  the  group  and  its  experience,  the  cultural  and 
political  environment  of  the  meeting,  and  the  nature  and  timing  of  desirable 
communications  within  the  group.  We  support  the  position  of  Russo  [441: 
"When  the  intelligence-gathering  phase  for  a  major  decision  is  complete,  the 
evidence  on  the  table  should  be  rich  enough  that  no  one  feels  his  or  her 
views  were  ignored".  When  fundamental  disagreements  persist,  the  group 
should  seek  to  separate  the  "factual"  issues  and  assumptions  underlying  each 
side's  position  from  their  value  judgements. 

Viewed  positively  a  decision  model  can  provide  a  framework  on  which  to  base 
a  protocol  of  questions,  each  set  of  responses  contributing  to  the  eventual 
group  decision.  See,  for  example,  17,22,28,51,531  for  descriptions  of 
models  of  decision  analysis.  The  vital  thing  is  that  the  protocol  needs  t 
expose  adequately  key  areas  of  agreement  and  disagreement  at  each  stage,  and 
identify  differences  of  understanding  of  the  problem  definition  so  that 
these  can  be  explored  by  debate,  and  sometimes  modified,  as  differences  in 
habitual  domains  become  clear,  1551.  Furthermore,  the  protocol  needs  to  be 
capable  of  identifying  key  areas  for  group  attention,  even  though  the 
decision  model  may  well  be  inadequate  as  the  final  arbiter  of  a  decision. 
It  is  in  support  of  the  communication  process  in  groups  that  GDSS  has  a 
unique  and  vital  role  to  play.    Keeney  1271   put  it  succinctly  in  a 
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description  intended  to  promote  good  decision-making: 

"...  a  good  analysis  should  illuminate  controversy  -  to  find 
out  where  basic  differences  exist,  in  values  and  uncertainties, 
to  facilitate  compromise,  to  increase  the  level  of  debate  and 
undercut  rhetoric...". 

Once  the  view  is  adopted  that  a  GDSS  can  be  used  as  a  stimulant  to 
"meaningful  debate,  it  has  the  potential  for  use  not  only  in  decision-making 
but  also  in  problem  formulation  and  idea  generation.  In  searching  for 
suitable  social  process  designs,  it  is  to  the  literature  in  applied  social 
psychology  that  we  may  turn.  In  particular,  there  are  the  well  developed 
group  and  team  based  techniques  of  "dialectical  inquiry"  and  "devil's 
advocate"  1453;  "brainstorming"  and  "creativity"  [42,46],  "Delphi"  154];" 
"nominal  group  technique"  1161;  Interpretive  Structural  Modelling  C 521 ;  and 
cognitive  mapping  1171 . 

Another  aspect  of  a  GDSS  system  is  its  potential  to  affect  group  processes 
prior,  during,  and  after  meetings.  A  GDSS  can  support  and  enhance  group 
processes  of  mutual  communication  and  understanding.  In  order  to  achieve  a 
group  goal,  and  maintain  individual  relationships,  a  suitable  balance 
between  task-related  ("instrumental  type")  behaviour  and  socio-emotional 
("expressive  type")  behaviour  needs  to  be  maintained  15,101.  Disagreement 
can  produce  tensions  in  the  group  which  may  impede  progress  on  the  task,  and 
these  tensions  need  a  mechanism  for  their  release  through  expressive  or 
emotional  types  of  behaviours.  An  experiment  conducted  by  Gear  [201  has 
demonstrated  that  composite  feedback  of  individual  scores  relating  to 
cognitive  perceptions  of  performance  and  feelings  during  a  meeting  can  have 
strong  effects  on  subsequent  behaviour. 

Rohrbaugh  [431  provided  participants  in  experimental  groups  with  cognitive 
feedback  of  their  individual  judgements  in  order  to  focus  their  discussions 
on  possible  representations  of  a  uniform  policy  for  the  group  overall.  It 
was  found  that  groups  were  thought  (by  their  members)  to  perform  better  when 
individual  cognitive  feedback  was  provided  to  each  member,  freely  exchanged, 
and  discussed.  In  a  series  of  experiments  with  student  groups,  [231  found 
that  "individual  learning  in  tasks  of  cognitive  conflict  derives  from  direct 
access  to  graphic  representations  of  members'  judgement  policies  that 
explicitly  communicate  the  key  differences  in  their  use  of  available 
information".   With  respect  to  building  group  consensus,  full  cognitive 


feedback  seemed  sufficient  to  focus  the  groups,  without  any  imposed  method 
for  structuring  the  discussions,  so  that  groups  were  able  to  reach  agreement 
on  a  policy  they  could  mutually  endorse.  Gear  [211  conducted  an  experiment 
of  this  type  with  a  group  of  R  &  D  managers  in  the  pharmaceutical  industry 
and  received  very  favourable  reactions  from  the  group  members. 

In  a  classical  series  of  experiments  1 41  demonstrated  a  high  level  of 
willingness  by  people  in  a  group  to  "go  along  with"  the  expressed  opinions 
of  the  majority.  It  appears  that  the  reasons  for  this  at  the  process  level 
are  either  a  lack  of  confidence  in  personal  judgement  or  a  desire  to 
conform.  1481  detected  an  effect  called  the  "risky  shift",  that  on  average 
groups  tended  to  make  riskier  decisions  than  the  individuals  involved  would 
make  on  their  own.  See,  for  example,  (501  for  a  detailed  account  of  social 
influence  and  conformity  phenomena.  Clearly,  the  existence  of  majority  and 
minority  social  influence  processes  in  groups  needs  careful  consideration  in 
designing  a  protocol.  In  presenting  a  view  on  removing  effects  of 
"groupthink"  in  managerial  settings,  Mann  1321  proposes  ...  "The  'learning 
organisation' ,  where  effective  group  decision-making  occurs  in  an  arena  of 
informed  and  enlightened  debate".  Additionally,  in  terms  of  management 
action,  it  is  generally  important  to  bear  in  mind  that  full  participation  in 
the  decision  process  is  often  the  key  to  commitment,  and  hence  successful 
implemention  [11. 

The  physical  design  of  GDSS  to  support  room-based  groups  has  taken  a  number 
of  forms.  For  example,  [25,381  have  described  experiences  with  managerial 
groups  in  which  each  participant  is  provided  with  a  personal  computer 
terminal,  with  all  of  the  terminals  linked  by  hard  wiring  to  a  large  screen 
display.  Experiments  involving  automatically  mediated  dialogue  in  groups 
with  specially  developed  hardware  and  software  have  also  been  described 
[471  . 


3   COMMUNICATION  TECHNOLOGY 

DESCRIPTION 

We  now  describe  the  system,  called  TEAMWORKER,  which  was  used  to  support 
each  of  the  managerial  situations  described  in  Section  4.  Some  early 
experiments  and  uses  of  this  system  have  been  described  in  [15,19,411. 

Each  member  of  the  group  is  provided  with  a  personal  handset.  This 
comprises  a  two-line  display  and  numeric  keypad.  The  keypad  is  styled  to 
mimic  a  telephone  layout  and  the  overall  appearance  is  that  of  a  simple  hand 
calculator.  These  features  of  the  design  are  deliberate  in  order  to  help 
overcome  emotional  barriers  to  the  use  of  technology  which  a  proportion  of 
people  do  exhibit,  and  to  minimise  the   intrusive  nature  of  any  technology. 

Numbers  entered  singly,  or  in  combination  up  to  a  total  of  four  digits,  can 
be  viewed  personally,  deleted  and  re-entered  as  desired  by  the  participant, 
and  finally  "sent"  as  a  digitalised  message,  using  low  power  radio.  The  use 
of  radio  is  an  advantage  as  it  is  unobtrusive  (wire-less)  ,  and  omni- 
directional, with  a  50  metre  range. 

The  messages  (digital  signals)  are  received,  as  sent  by  each  participant,  at 
a  receiver  module  which  is  hard-wired  to  a  micro-computer  located  at  a 
convenient  point  away  from  the  group.  The  computer  is  arranged  to  provide  a 
large  screen  display  so  that  there  is  direct  visual  feed  back  to  the  whole 
group.  The  design  of  the  software  is  varied  to  suit  the  objectives  of 
particular  meetings  or  contexts.  The  IT  system  is  shown  in  figure  1,  and 
the  generalised  flow  of  information  between  the  system  and  the  group  is 
shown  in  figure  2. 
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JUDGEMENTAL  PROCESSES 

Certain  processes  are  especially  useful,  depending  on  the  issues  involved. 
Some  important  ones  are  itemised  below: 

( i)      Voting 

Uses  include  selecting  an  item  or  option  from  a  set,  multiple 
choice. 

( ii)     Scoring  Options 

Uses  include  evaluating  each  of  a  set  of  items  or  options  on  a 
pre-defined  scale,  scoring  as  a  means  of  producing  lists  in  rank 
order,  scoring  as  a  means  of  filtering  long  lists  to  short-lists. 

(iii)     Comparing  Options 

Uses  include  weighting  the  relative  importance  of  a  set  of  criteria 
by  means  of  pairwise  comparisons,  evaluating  subjective  factors  and 
parameters,  assessing  subjective  probabilities  and  probability 
distributions,  and  assessing  attitudes  to  risk. 

( iv)     Direct  Assessment 

Uses  include  the  estimation  of  parameters,  probabilities  and  other 
factors  by  direct  and  subjectively  based  inputs. 

JUDGEMENTAL  MODELLING  STAGES 

The  use  of  an  on-line  system  supporting  the  group  means  that  these  processes 
can  be  undertaken  much  more  effectively,  facilitating  immediate  feedback  to 
the  group.   Judgemental  modelling  involves  the  following  ordered  stages:- 

(i)      Establish  the  judgemental  issue(s) 

(ii)     Present  carefully  designed  questions  to  the  group 

(iii)     Obtain  responses  from  the  group  using  individual  handsets 


(iv)     Display  the  range  of  responses  back  to  the  group 

(v)      Stimulate  debate  of  principle  points  of  agreement  and  disagreement 

(vi)  Repeat  any  of  the  above  steps  until  there  is  some  form  of 
agreement,  and/or  the  differences  within  the  group  are  understood 
and  accepted 

JUDGEMENTAL  SCALES 

Each  application  of  judgemental  modelling  requires  careful  attention  to  the 
scale(s)  to  be  used  with  the  group.  It  is  important  that  a  scale  is  matched 
to  the  task,  and  that  the  defined  point(s)  on  the  scale  are  clearly 
established  and  agreed.  The  scale  and  its  anchor  point(s)  may  sometimes  be 
developed  with  the  help  of  the  group,  but  must  be  understood  by  every 
participant.  We  have  found  nominal,  ordinal,  interval  and  ratio  scales  all 
of  use  on-line.  It  is  important  to  ensure  that  questioning  procedures 
relating  to  measurement  scales  are  logically  consistent  with  any 
mathematical  operations  in  order  to  avoid  the  introduction  of  systematic 
errors.  See,  for  example  Belton  191  for  a  discussion  of  this  issue  m 
connection  with  pairwise  comparisons. 

4.   FIELD  APPLICATIONS 

This  section  is  intended  to  present  in  brief  each  of  a  number  of 
applications  of  the  support  technology  described  in  Section  3. 

Each  application  is  described  under  the  headings  of  background,  process 
model,  and  experience.  The  applications  support  the  development  of  a 
generalised  process  framework  presented  in  Section  5. 

The  applications  concern  groups  in  organisations  engaged  in  strategic  as 
well  as  routine  tasks  of  a  "recurring"  as  well  as  "once  only"  type.  Another 
aspect  to  note  is  that  having  designed  a  suitable  process  for  each 
organisation,  incorporated  into  specially  developed  or  modified  software, 
the  groups  were  sometimes  largely  or  totally  left  to  operate  the  support 
system  technology  for  themselves,  so  minimising  any  influences  and  biases 
that  a  facilitator  presence  can  have  (391. 
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A.     Portfolio  selection  in  commercial  R  and  D 

Background 

The  organisation  is  a  multinational  pharmaceutical  group,  with  R  and  D 
laboratories  collaborating  with  each  other  but  based  at  sites  in  Europe  and 
North  America.  The  decision  area  is  concerned  with  the  selection  of  a 
preferred  portfolio  of  projects  to  which  to  allocate  scarce  resources, 
especially  manpower. 

A  number  of  factors  are  taken  into  account  in  this  process,  including  market 
potential,  competition,  stage  in  development,  chances  of  technical  success, 
therapeutic  area  balance,  long  and  short  term  returns,  resource  constraints 
and  key  resource  availabilities.  A  series  of  meetings  is  held  each  year  to 
decide  the  portfolio,  and  other  review  meetings  are  called  at  other  times  to 
decide  changes. 

Process  Model 

The  GDSS  was  used  by  committees  within  each  therapeutic  area,  and  the 
outcomes  of  these  meetings  were  used  as  inputs  to  subsequent  meetings  of  the 
development  committee.  Rank  ordered  lists  were  produced  within  each  area 
under  headings  of  "early  stage"  and  "near  market  projects".  These  were 
considered  in  terms  of  various  commercial  and  technical  criteria  as  well  as 
other  factors  and  information.  The  development  committee  produced  overall 
rank-ordered  lists  for  the  two  project  categories,  and  from  these  an  overall 
prioritized  list.  Resource  constraints  and  issues  of  portfolio  balance  were 
considered  in  order  to  decide  the  preferred  overall  portfolio.  The  software 
was  designed  to  facilitate  a  variety  of  processes,  especially  scoring  on 
criteria,  voting  on  issues,  and  pairwise  comparisons.  At  every  stage  the 
software  enabled  displays  of  differences  of  opinion  to  be  debated  and 
changes  to  be  made  so  that  the  group  was  able  to  progress  flexibly  with  many 
interactions. 

Experience 

The  whole  process  was  spread  over  several  weeks  and  involved  a  number  of 
linked  meetings.  Most  of  the  time  there  was  a  high  level  of  agreement,  but 
at  certain  points  there  was  great  disagreement,  and  much  debate  and  repeat 
inputting.   During  the  meetings  there  was  a  small  number  of  occasions  when 
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fundamental  and  important  disagreements  persisted  and  there  was  not  even  a 
simple  majority  position.  The  leader  then  focussed  debate  on  isolating 
whether  the  differences  related  to  "factual"  information  or  assumptions  or 
to  fundamental  values.  In  most  cases  a  consensus  emerged  at  these  points, 
and  in  only  one  instance  a  finely  balanced  judgement  was  finally  taken  by 
the  chair.  Given  that  this  person  carried  the  ultimate  responsibility, 
there  was  at  this  stage  a  consensus  that  this  was  the  preferred  way  t 
resolve  the  difference  of  opinion  given  that  the  issues  had  been  well 
explored  and  understood  in  debate. 

The  Director  of  Project  Management  stated  that  "it  is  possible  to  take  a 
vote  at  the  beginning  of  a  discussion  to  gauge  the  feeling  of  the  meeting  on 
an  issue.  That  pinpoints  whether  you  need  to  discuss  it  more.  It 
facilitates  the  process  of  debate  and  rapidly  ensures  you  get  to  a  clear-cut 
decision  ...  it  is  a  very  useful  tool  for  facilitating  appropriate 
discussion  and  ensuring  that  you  spend  time  dealing  with  things  that  need  to 
be  discussed  rather  than  on  things  that  are  foregone  conclusions"  161.  He 
also  noted  that  the  time  taken  in  meetings  was  substantially  decreased  and 
yet  stated:  "I  have  greater  confidence  in  the  decisions  taken".  These 
comments  generally  support  some  of  the  conclusions  of  12,34],  that  the 
stimulation  of  communication  in  R  &  D  is  a  pre-requisite  to  output  from  R  & 
D,  and  also  that  face-to-face  communication  is  essential  for  an  efficiently 
operating  information  network. 

B     Research  Proposal  Selection  in  a  Public  Body 
Background 

The  organisation  is  a  British  Research  Council.  Committee-based  decisions 
concerning  the  selection  for  funding  of  research  proposals  submitted  by 
researchers  in  Universities  and  Polytechnics  are  considered  by  peer  review. 
Committees  of  15  to  25  members  consider  long  lists  of  proposals  in  each  of  a 
number  of  scientific  areas.  The  overall  budget  is  pre-defined,  but  the 
precise  apportionment  of  this  figure  between  the  scientific  areas  is 
deliberately  left  open  when  the  committees  meet. 

Process  Model 

The  complete  list  of  proposals  was  held  in  the  software,  so  that  they  could 
each  be  called  up  for  display  in  list  or  other  order.   Each  proposal  was 
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presented  by  defined  committee  members,  referees'  comments  noted,  and  a 
short  discussion  of  views  and  points  of  clarification  held.  At  this  point 
the  chairperson  summarised  the  position  and  stated  whether  this  project  was 
of  a  fundable  type  (as  opposed  to  a  reserve  list,  a  rejection  or  a 
resubmission).  When  fundable,  the  committee  members  each  scored  the  given 
proposal  on  each  of  the  two  criteria:  "scientific  excellence"  and  "relevance 
to  policy".  The  scale  used  was  based  on  1  (low)  to  5  (high),  and  was  very 
familiar  to  the  membership  having  been  in  use  over  several  years.  The 
extremes  were  defined  in  a  "global"  rather  than  a  "local"  sense. 

Mean  score  and  standard  error  of  the  mean  was  displayed  after  each  set  of 
inputs.  These  were  infrequently  debated  further  at  this  stage.  After  all 
proposals  had  been  treated  in  this  way,  an  overall  rank  ordered  list  of 
fundable  projects  was  displayed,  based  on  mean  scores  for  "scientific 
excellence"  only,  while  displaying  the  "relevance  to  policy"  mean  and 
standard  error  as  well. 

The  running  total  of  aggregate  first  year  costs  was  also  displayed. 
Definition  of  an  approximate  range  from  minimum  to  maximum  budget  allocation 
to  the  given  committee  allowed  identification  of  the  "grey"  projects  falling 
within  this  range.  The  grey  projects  were  then  carefully  reviewed  again  by 
the  committee.  Further  discussion  took  place  and  recommendations  were  made 
to  the  officers  concerning  the  preferred  portfolio  under  various  overall 
budget  constraints.  Exceptionally,  some  proposals  were  discussed  further 
and  then  re-scored  at  this  stage. 

Experience 

All  committees  of  the  Research  Council  have  been  using  the  system  for  three 
years  on  a  twice  yearly  basis.  After  initial  reservations  by  some  members 
(111,)  both  the  Council  Officers  and  the  peer  review  groups  appear  to  find 
the  system  a  useful  aid.  A  senior  officer  concerned  stated:  "The  Council 
gets  more  information  than  before,  with  significantly  more  precision". 

It  may  be  argued  on  statistical  grounds  that  the  scale  with  five  points  only 
is  too  coarse,  and  that  a  scale  with  more  divisions  is  preferable.  Against 
this  is  the  fact  that  the  scale  has  been  used  for  several  years  in  a 
"global"  sense  by  committees  in  which  the  membership  is  fairly  stable  from 
year  to  year.  A  change  would  mean  the  re-establishment  of  a  presently  well 
understood  process.   Further  details  of  this  application  have  been  described 
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by  Cherfas  (1990) . 

C.     Perceptions  in  Retail  Marketing 

Background 

The  organisation  is  a  medium-sized  retail  chain  selling  a  wide  range  of 
audio,  video  and  TV  equipment  with  a  significant  regional  presence  and 
image.  In  particular,  it  had  achieved  a  pre-eminent  position  in  terms  of 
certain  up-market  brands.  It  was  thought  by  some  store  managers  that 
prospective  customers  viewed  the  company  as  expensive  and  up-market  because 
the  expensive  brands  were  stocked  and  associated  strongly  with  the  chain. 
The  management  group  were  in  disagreement  as  to  how  their  other  lower 
priced,  mainly  Japanese,  brands  were  perceived  by  their  customers,  and  how 
closely  the  chain's  image  related  to  these  other  brands. 

Process  Model 

A  number  of  exercises  were  run  through  with  a  group  of  seven  store  managers 
at  a  one-day  meeting  in  order  to  measure  perceptions  and  debate  differences. 
The  work  involved  is  briefly  described  in  what  follows,  and  further  details 
have  been  described  in  tlSl.  The  managers  considered  the  set  of  brand  names 
that  they  stocked  in  each  of  a  number  of  product  areas.  Each  brand  was 
considered  on  each  of  a  set  of  attributes  using  "local"  scoring  scales.  The 
attributes  themselves  were  assessed  in  terms  of  relative  importance  by 
pairwise  comparisions.  The  managers  responded  from  their  own  point  of  view 
and  also  from  the  (perceived)  point  of  view  of  their  customers.  Holistic 
analyses  were  also  undertaken  of  how  they  perceived  their  stores  compared 
with  competing  store  chains  on  each  of  a  number  of  attributes.  At  every 
stage,  discussion  and  debate  was  related  to  the  feedback  screens  which 
displayed  agreements/disagreements  of  opinion,  rather  than  results  of 
mathematical  analysis. 

Experience 

The  meeting  continued  for  several  hours  and  most  of  this  time  was  spent  in 
discussions  of  the  reasons  for  differences  in  views  represented  on  feedback 
screen  displays.  At  times  considerable  surprise  regarding  revealed 
differences  was  generated  in  this  way,  even  though  this  was  a  group  of 
managers  who  had  worked  together  for  a  considerable  time  and  knew  each  other 
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well.  At  the  conclusion  of  the  meeting,  participants  had  decided  on  the 
brands  which  offered  the  most  scope  for  their  chain,  and  were  formulating  a 
marketing  strategy  including  some  well  defined  attributes  for  subsequent  use 
in  market  research  exercises. 

D.     Option  Selection  in  Defence 

Background 

The  organisation  is  a  research  establishment  within  the  U.K.  Ministry  of 
Defence.  A  set  of  seven  options  had  been  identified  for  a  military  system 
to  meet  a  well  defined  threat.  A  considerable  amount  of  experimental  and 
simulation  based  data  was  available.  The  criteria  by  which  to  judge  the 
options  were  pre-defined. 

Process  Model 

As  a  means  of  exploring  further  the  relative  merits  of  the  options,  a  group 
of  twelve  military  experts  was  assembled  for  a  one-day  meeting.  The  options 
were  considered  on  each  of  the  criteria  in  turn.  Each  participant  was  asked 
to  define  and  anchor  the  end  points  of  rating  scales  with  their  personal 
(and  at  this  stage,  confidential)  highest  and  lowest  rated  options  on  each 
of  the  given  criteria.  Following  this,  the  group  entered  their  personal 
ratings  on  each  option  for  each  of  the  criteria  taken  in  turn.  As  each  set 
of  inputs  was  completed,  they  were  immediately  displayed  back  to  the  group 
for  discussion.  During  these  debates,  re-definition  of  some  of  the  criteria 
took  place,  and/or  the  number  of  criteria  changed.  Sometimes  the  ratings 
were  repeated  as  a  result  of  this  or  other  debates. 

The  relative  importance  of  the  criteria  themselves  were  then  considered 
using  a  constant  sum  method.  The  criteria  were  taken  in  pairs  and  100 
points  allocated  between  the  pairs  by  each  participant  without  prior 
discussion  (see  [131  for  "constant  sum"  method).  They  were  asked  to 
allocate  these  points  according  to  the  "swing  weights"  definition  of 
relative  importance  (e.g.  see  [531).  When  all  pairwise  comparisons  were 
completed,  the  importance  weights  were  displayed  as  values  and  rankings 
tables  across  the  set  of  criteria  and  the  participants.  This  generated 
discussion  and  a  re-run.  Finally,  an  "overall"  result  for  each  individual 
was  displayed  by  calculating  a  summation  of  the  scores  times  the  weights 
for  each  option  over  the  criteria  set.   Differences  displayed  at  this  stage 
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generated  further  debate.  An  exploration  of  the  sensitivity  to  change  of 
these  results  was  presented  on-line  by  changing  first  the  scores  and  then 
the  weights.  In  a  final  debate  the  option  preferred^  by  the  group  overall 
was  selected  by  consensus. 

Experience 

The  participants  seemed  very  happy  with  the  process,  especially  the  frequent 
opportunities  to  debate  well  focused  issues.  The  meeting  was  considered 
effective  by  all  participants,  and  further  meetings  concerned  with  other 
issues  are  now  frequently  held.  As  seen  by  the  establishment  facilitator 
"the  use  of  TEAMWORKER  enao.ci  us  and  our  sponsors  to  examine  potentially 
contentious  issues  in  a  methodical  and  transparent  manner,  producing 
acceptable  quantifications  of  "quality"  and  "policy"  factors  for  use  in 
decision  making". 

E.     Analysis  of  Key  Competencies  and  Task  Performance 

Background 

This  application  is  located  in  the  brewing  industry.  The  Chief  Executive 
had  formulated  a  clear  vision  statement  for  the  business,  and  also 
established  a  set  of  thirteen  associated  key  task  performance  factors.  These 
were  the  set  of  task  abilities  he  expected  in  his  key  team  of  operational 
managers  in  order  to  achieve  the  vision.  It  was  considered  essential  to 
assess  the  strengths  and  weaknesses  of  the  key  team  of  managers  both 
individually  and  as  a  whole. 

Process  Model 

A  meeting  was  held  of  the  group  composed  of  board  directors.  Each  of  the 
managers  was  assessed  on  each  of  the  key  task  factors  using  a  scoring  scale. 
At  each  stage,  summary  screens  displayed  differences  of  opinion  and  this 
resulted  in  mini-debates  and  occasional  re-scoring.  It  also  led  to 
improvements  in  understanding  of  the  definitions  of  the  task  factors 
themselves.  The  relative  importance  of  each  of  the  competencies  was  also 
evaluated  by  means  of  pairwise  comparisons.  Summary  screens  enabled  the 
board  to  evaluate  gaps  in  key  task  areas  at  the  individual  and  group  level 
and  to  assess  their  importance.  Discussion  then  led  to  conclusions 
concerning  how  certain  gaps  should  be  closed.   This  involved  a  consideration 
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of  options  centred  around  internal  development  of  staff  as  opposed  to 
recruitment.  Later,  competency  data  was  matched  to  the  task  data  in  order 
to  predict  future  task  performance. 

Experience 

The  meeting  resulted  in  management  action  with  the  help  of  a  team-building 
consultant  working  within  the  organisation.  The  consultant  stated:  "the 
multiple  ratings  carried  out  in  this  way  were  sometimes  at  odds  with 
performance  appraisals  and  pinpointed  weak  areas  quickly  so  that  they  could 
be  given  attention". 

F.     Long  Range  Planning 

Background 

The  organisation  is  a  large  multi-national  manufacturing  company  in  a  high 
technology  business.  Concern  was  expressed  to  ensure  that  the  company  was 
making  good  decisions  regarding  technologies  to  be  in  for  commercial 
introduction  and  exploitation  on  10-30  year  future  time  frames. 

Process  Model 

A  long  list  of  "business  drivers"  was  developed  during  a  brainstorming 
session  with  a  group  of  twelve  executives  from  scientific  and  commercial 
areas  of  the  company.  These  are  the  factors  likely  to  influence  strongly 
the  relative  importance  of  future  business  options.  They  can  involve 
social,  technological,  political,  cultural,  economic,  environmental  and 
military  scenarios. 

A  larger  group  of  45  executives  representing  all  areas  of  the  company,  as 
well  as  scientific  and  commercial  expertise,  was  assembled.  The  long-list 
of  drivers  was  then  scored  on  a  high-low  interval  scale  in  order  to  discuss 
differences,  average  inputs,  and  filter  to  a  much  shortened  high  priority 
list. 

A  long  list  of  "business  options"  was  then  generated  in  relation  to  the 
important  business  drivers.  These  were  similarly  filtered  to  a  shorter  list 
by  scoring.  The  short-list  was  then  scored  on  two  criteria  on  local 
high-low  interval  scales  established  for  each  participant.    The  criteria 
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were  defined  in  terms  of  "likelihood"  and  "zone  of  influence".  Results  were 
viewed,  discussed,  and  sometimes  re-scored.  Eventually,  the  averaged  scores 
were  displayed  on  a  two  dimensional  grid,  along  with  ellipses  based  on  the 
standard  errors.  Differences  between  scientific  and  commercial  sub-groups 
were  explored  for  significance  and  discussed.  Eventually  agreement  on  the 
top  priority  business  options  was  reached  along  with  the  implications  for 
appropriate  technologies  of  greatest  concern  to  the  company  in  the  future. 

Experience 

The  final  three  days  of  runs  were  undertaken  without  facilitation  in  the 
conference  room  in  order  that  no  "external  influences"  were  present  to  bias 
or  distort  results.  On  completion,  the  participants  were  very  pleased  with 
the  process  in  terms  of  opportunities  to  both  input  their  judgements  via 
handsets  and  to  express  their  feelings  during  focused  debates.  The  managing 
team  were  provided  with  clear  steers  in  terms  of  the  areas  requiring  further 
attention.  Following  the  meetings,  the  organising  officer  stated:  "We 
couldn't  have  had  that  event  without  your  system.  We  might  have  had  some 
other,  more  conventional,  meeting  but  I  don't  think  it  would  have  been 
nearly  as  productive". 

G.     University  Based  Education  and  Training 

Background 

The  situation  involved  undergraduate  teaching  in  a  university-based 
Department  of  Pharmacy.  The  need  was  to  ensure  the  development  of 
professional  skills  when  dealing  with  patients,  and  in  accurate  prescribing 
of  appropriate  drugs  or  medication  for  a  given  condition.  This  involved  the 
relationship  with  the  patient  in  order  to  make  a  proper  diagnosis  and 
prescription  decision. 

Process  Model 

Video  training  film  was  shown  on  a  large  screen.  This  was  sometimes 
commercially  available  material,  and  sometimes  vignettes  produced  by  the 
students  themselves.  The  video  film  was  paused  at  appropriate  points  in  a 
series  of  sequences  of  dialogue  between  the  patient  and  the  pharmacist.  The 
same  large  screen  then  displayed  an  appropriate  question  and  set  of 
alternative  answers.   This  multiple  choice  format  was  sometimes  varied  into 
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"yes-no"  and  other  binary  options. 

The  students  responded  with  handsets,  either  individually,  or  in  groups  of 
up  to  four.  Histograms  of  the  responses  received  were  displayed  on  the 
screen  so  that  the  lecturer  concerned  could  easily  run  a  discussion  based  on 
the  range  of  answers.   The  next  video  clip  was  then  presented,  and  so  on. 

Experience 

Lecturers  working  with  the  system  have  noted  a  greatly  increased  level  of 
attention,  interest  and  preparedness  to  participate  in  classroom  debate  from 
all  the  students  involved.  When  the  students  formed  small  teams  to  a  single 
handset,  a  spirit  of  competition  between  the  teams  was  generated.  This 
meant  that  "within  team"  debate  as  well  as  plenary  debate  took  place, 
enhancing  mutual  learning.  The  system  is  being  regularly  utilised  by  the 
department  concerned  which  we  believe  is  most  significant.  It  is  planned  to 
evaluate  whether  significantly  enhanced  learning  and  retention  is  taking 
place  by  comparison  with  other  student  groups  not  using  this  approach. 

H.     Panel  Testing  and  Tasting 

Background 

The  organisation  is  a  major  brewer  with  a  large  range  of  beers  and  lagers  at 
a  number  of  dispersed  sites.  Production  is  tasted  and  tested  by  panels  of 
experts  on  a  daily  basis.  The  objective  is  to  identify,  for  each  branded 
product,  deviations  in  either  direction  from  a  defined  product  profile.  The 
profile  is  based  on  35  dimensions  related  to  identifiable  aspects  of  taste, 
appearance  and  smell. 

Process  Model 

It  was  important  to  allow  each  participant  to  respond  during  the  tasting 
process  in  his/her  own  time,  and  by  exception.  A  scoring  scale  with 
allowance  for  positive  or  negative  deviations  from  a  correct  (zero)  profile 
for  each  beer  was  already  in  use  and  very  familiar.  This  scale  was 
incorporated  into  the  software.  The  screen  was  sectored  for  responses  from 
particular  numbered  handsets.  On  completion  of  the  inputs  on  each  of 
typically  eight  beers,  the  values  were  displayed  back  to  the  panel  in  a 
histogram   form   for  each  beer  on  each   dimension.     Where   significant 
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differences  of  opinion  were  observed  they  were  debated.  The  participants 
sometimes  re-tasted  and  re-scored  at  these  points. 

Experience 

The  process  was  fast  and  delivered  timely  outputs  for  debate  during 
tastings.  The  system  is  now  being  adopted  by  the  organisation  with  a  view 
to  maintaining  standards  within  and  between  sites.  The  system  is  also  being 
used  to  facilitate  the  training  of  new  panel  members,  to  set  standards,  and 
also  to  identify  trends  in  production  output  quickly. 

5.   A  PROCESS  FRAMEWORK 


In  Section  2  we  have  overviewed  the  literature  connected  with  social  choice, 
multiple  criteria  decision  making,  and  social  processes  in  groups  engaged  on 
decision  related  tasks.  From  this  work,  and  our  own  field  experience 
summarised  in  Section  4,  we  postulate  the  following  general  guidelines 
within  which  to  focus  the  design  of  GDSS  in  varied  settings: 

1.  Each  participant  should  be  fully  involved  in  those  stages  of  the  process 
which  are  not  pre-ordained  by  the  context.  In  particular,  setting 
objectives,  generating  alternatives,  establishing  and  defining  criteria 
with  which  to  judge  alternatives.  These  should  be  openly  discussed, 
changed  and  filtered  as  the  meeting  progresses  in  a  dynamic  way. 

2.  As  a  means  of  identifying  useful  points  of  debate,  and  aiding  meaningful 
discussions,  all  participants  should  have  opportunities  to  input  for 
group  display  their  judgements  in  terms  of  evaluations  of  the 
alternatives  against  each  of  the  criteria,  and  of  the  relative 
importance  of  the  criteria,  one  with  another,  at  a  series  of  defined 
stages.  At  each  stage,  the  complete  set  of  inputs  should  be  received 
prior  to  display  to  minimise  social  biasing  effects. 

3.  Feedback  of  evaluations  at  each  stage  should  be  simple  and  graphic, 
displaying  the  set  of  values  received  from  the  group  in  a  transparent 
way,  with  as  little  processing  as  possible,  enabling  a  discussion  of 
points  of  agreement  and  of  disagreement  (especially  of  polarised  views). 

4.  At  any  stage,  display  of  differences  of  opinion  followed  by  debate  may 
indicate  the  need  to  revisit  that  stage  or  any  earlier  stage  of  the 
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process,  and  this  should  be  taken  without  hesitation. 

5.  At  some  stages,  it  may  be  useful  to  aggregate  results  from  each  of  the 
participants  in  some  mathematical  process  of,  for  example,  adding  or 
averaging.  On  each  occasion,  this  process  should  be  made  very  clear  to 
the  group  as  well  as  any  inherent  shortcomings  it  may  contain. 

6.  As  a  result  of  the  inputs,  feedbacks,  discussions  and  analyses,  the 
group  should  reach  a  collective  choice,  which  is  an  agreed  and  preferred 
result,  achieved  by  means  of  debate. 

7.  The  technology  of  decision  support  should  seek  to  aid  and  enhance  group 
processes  and  not  inhibit  or  dominate  them,  which  requires  careful 
attention  to  design  aspects  concerned  with  both  hardware  and  software. 

8.  Procedures  and  evaluation  methods  should  be  constructed  to  build  on  from 
the  cultural  settings  and  prior  experience  of  the  group  as  part  of  a 
joint  learning  and  development  experience.  These  aspects  may  well  need 
attention  in  advance. 

9.  Questions  requiring  input  of  judgement  from  participants  should  always 
be  formulated  in  clear  and  unambiguous  terms.  There  is  never  a  case  for 
introducing  fuzziness  over  and  above  that  which  is  inherently  present. 
This  is  particularly  true  of  scale  definitions  for  scoring  or  comparing 
items. 

6.   CONCLUSIONS 


Many  important  decisions  in  organisations  are  made  in  group  contexts,  even 
though  one  member  of  the  group  is  sometimes  ultimately  responsible  for 
actually  taking  the  decision.  Group  decision  processes  are  not  merely 
extensions  of  the  processes  appropriated  to  individuals  when  engaged  in 
decision-making.  A  new  entity  is  created  with  its  own  decision  related 
dynamics.  The  dynamics  involve  complex  social  processes  of  communication 
and  position  modification  between  participants.  A  group  decision  support 
system  can  aid  these  social  processes  by  means  of  appropriately  designed 
software,  incorporating  selected  features  from  multiple  criteria 
decision-making,  and  other  managerial  processes  developed  to  aid  group 
dialogue.  There  are  many  ways  in  which  this  can  be  done,  depending  on  the 
particular  context. 
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This  choice  needs  to  take  account  of  aspects  of  social  influence  often 
considered  to  be  deleterious  in  their  effects.  Of  value  in  this  connection 
are  the  management  tools  of  Nominal  Group  Technique,  Group  Delphi  and 
various  forms  of  Brain-Storming,  as  these  seek  to  encourage  dialogue  after 
sets  of  inputs  from  group  members,  so  reducing  conformity,  risky  shifts,  and 
other  related  phenomena. 

The  choice  also  needs  to  take  account  of  the  degree  of  abstraction  implicit 
in  the  use  of  a  particular  decision  analytic  framework,  usually  developed 
for  aiding  individual  rather  than  group  decision-making.  The  framework  can 
"provide  a  common  language  for  communications  and  pinpoint  agreements  and 
disagreements"  ( 51J .  The  primary  use  of  the  framework  is  to  provide 
quantification  as  a  tool  for  structuring  thought  so  that  the  range  of 
opinions  can  be  explored  in  debate,  rather  than  merely  to  perform 
mathematical  operations  of  aggregation,  which  do  have  fundamental 
shortcomings. 

Finally,  and  perhaps  paradoxically,  the  technology  of  GDSS  may  assist  a 
group  process  by  enhancing  individual  processing.  Or  as  George  Herbert  Mead 
[33]  elegantly  stated: 


"The  individual  ....  becomes  an  object  to  himself  only  by 
taking  the  attitude  of  other  individuals  towards  himself 
within  a  social  environment  or  context  of  experience  and 
behaviour  in  which  both  he  and  they  are  involved." 
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